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Abstract 



o 

i^ ■ Landauer discussed the minimum energy necessary for computation and stated that erasure of 

Q>^ I information is accompanied by heat generation to the amount of fcrhi2/bit. Modifying the above 

statement, we claim that erasure of information is accompanied by entropy generation khi2/hit. 

Some new concepts will be introduced in the field of thermodynamics that are implicitly included in 
i-rt '' our statement. The new concepts that we will introduce are "partitioned state" , which corresponds 

to frozen state such as in ice, "partitioning process" and "unifying process" . Developing our 

statement, i.e., our thermodynamics of computation, we will point out that the so-called "residual 
H I entropy" does not exist in the partitioned state. We then argue that a partioning process is an 

O ' entropy decreasing process. Finally we reconsider the second law of thermodynamics especially 

when computational processes are involved. 



X 

^ . §1 Introduction 

About forty years ago Landauer discussed the minimum energy necessary for computation [l|. His 
conclusion is that 

[ L ] erasure of information is accompanied by heat generation to the amount of A;Tln2/bit. 

It seems that his theory has been accepted widely |||, |^. In our opinion, however, a more precise 
expression must be that 

[ IF ] erasure of information is accompanied by entropy generation A;ln2/bit. 

The aim of the present paper is not to compare the above two statements but to point out some 
new concepts in the field of thermodynamics which are implicitly included in statement [ IF ]. The 
new concepts that we will introduce are "partitioned state" (, which corresponds to frozen state such 
as in ice), "partitioning process" and "unifying process". 

We first explain [ IF ], namely, our thermodynamics of computation. It will be pointed out that the 
so-called "residual entropy" does not exist in the partitioned state. We then argue that a partioning 
process is an entropy decreasing process. Finally we reconsider the second law of thermodynamics. 



§2 Thermodynamics of computation 

A hardware with one-bit memory corresponds to a bistable physical system(, for example, a particle 
in a double- well potential). The system can take two stable states which we call state "0" and state 
"1" . In the situation that the system stays in one of the stable states and never moves to the other 
stable state, we say that the system is in a "partitioned state" . This can be realized if the temperature 
is low enough in comparison with the potential barrier separating the two stable states. There are two 
partitioned states corresponding to "0" and "1" . The system functions as a memory device in one of 
the partitioned states, by keeping one bit of information. Thus we will call the partitioned states as 
"m(memory)"- state which can be "0" or "1". 

If the potential has been modified from double-well to single-well, the system can take only one 
stable state. Then we say that the system is in a "unified state" . By the change of the system from 
a partitioned state to a unified state, one bit of information is lost. We will call the unified state as 
"n(neutral)" -state. 

We will study the thermodynamics of computation by using two models for a one-bit memory 
device. 

§2.1 Szilard Engine 

This is an idealized model of a memory device and is helpful to see the essence of physics in 
computational processes. The engine consists of a molecule, a cylinder, two pistons and a partition 
sheet (Fig. 1). 




Fig. 1: Szilard engine. 

The molecule is interacting with a heat bath with the temperature T. When the partition sheet 
is inserted, the engine is in one of "m"-states, i.e., "0" or "1". In state "0" ( "1" ), the molecule is in 
the left-hand (right-hand) side. When the partition sheet is removed, the engine is in "n"-state. 

Differences between thermodynamical quantities in "m"- and "n" -states are 

Energy: A^ = Er,-E^ = 0, 

Entropy : AS" = S^ — Sm = A: In 2, (1) 

Free energy: AF = Fn - F^ = AE-TAS = -kT ln2. 

§2.1.1 "Writing process" 

"Writing process" is as follows: The initial state is the "n"-state. An agent who performs a 
computation pushes one of the two pistons to the center of the cylinder, inserts the partition sheet 
and returns the piston to the starting position. In this process the agent does some work on the 
molecule, which amounts to 

I^„rite = -AF = A:rin2. 



During this process the entropy AS moves from the system to the heat bath, i.e., the environment, 
corresponding to which the heat generation occurs: 

Q^rite = T AS = kT ln2. 

Evidently, the "writing process" is reversible. 

§2.1.2 "Reversible-deleting process" 

There are two kinds of deleting process. The first one is the inverse of the 'writing process'. Then 
the work done by the agent and the heat generation in the environment are given by 

W^delete = -VFwrite = -/cT In 2, ^^, 

^jdelete ^ "Vwrite ^ —Kl In 2. 

Therefore the energy necessary for one cycle ("writing" + "reversible-deleting" ) is zero and so is 
the net heat generation: 

•^ rev— cycle ^jrev— cycle U. 

However, the above deleting process is possible only when the agent knows the content of the 
memory, i.e., in which state of "0" and "1" the system is. This implies that the same information 
remains in some other memory device after the deletion. 

§2.1.3 "Irreversible-deleting process" 

In this process the agent simply pulls out the partition sheet. Obviously the agent can do it 
without any information on the device. Both the work and the heat generation are zero in this case: 

•^irr— delete — Virr— delete — 'Jj 

but the entropy is produced in the engine which amounts to 

Sg = kln2. 

The cost of energy for one cycle ( "writing" + "irreversible deleting") and the net heat generation are 
given by 

"^irr— cycle ^ n/ii-r— cycle ^ ^ ^g ^ "'-' inz. 

§2.2 A particle in a bistable-monostable potential 

This model (see Fig. 2) is mathematically equivalent to a quantum flux parametron (QFP) device 
invented by Goto[0]. 





Fig. 2: A particle in a bistable-monostable potential, (a) "m"-state,"m"= "1". (b) "n"-state. 



Instead of pushing the pistons in the Szilard engine a bias potential is appHed in this model. The 
partition sheet is replaced by a potential hill at the center. It is easily shown that the necessary energy 
and the net heat for one cycle ("writing" + "deleting") are the same as those in the Szilard engine: 

l^rcv— cycle — ^jrcv— cycle — 'J) /•o'\ 

KKirr— cycle — ^irr— cycle — -^ ^g — ^-^ ^^ ■^* 

It should be noted that the amount of entropy generated in the "irreversible-deleting process" is equal 
to that for the Szilard engine. The reason is as follows. Entropy is generated when the height of the 
central hill is lowered so that the particle can jump into the other well by thermal noize. At this 
moment the volume of the phase space where the particle can walk around expands twice. This means 
A; In 2 of entropy is generated. 

We summarize the thermodynamics of computation as follows. Deletion of information is physically 
realized by a "unifying process" of a "partitioned state" , which means that the barrier (the partition 
sheet in the Szilard engine, the potential hill in the bistable-monostable system) is removed and the 
two separated phase spaces are unified. This process is irreversible and accompanied by the entropy 
production. 

§3 Residual entropy 

It is widely believed that a material whose ground state is degenerate has fclnWd of residual 
entropy at low temperatures, where Wd is its degeneracy. A well-known example is ice whose W^ is 
almost equal to 2 , where N is the number of hydrogen atoms. The potential energy of a hydrogen 
atom has two minimum points between the neighboring two oxygen atoms, which is the origin of the 
degeneracy. At low temperatures each hydrogen atom is localized at one of the two minimum points. 
Therefore the ice is in a partitioned state in our terminology. If the ice really has residual entropy, 
our memory device also must have kln2 of entropy in "m"- state where "m" is "0" or "1". However 
this contradicts the entropy production in the "irreversible-deleting process". We believe that the 
thermodynamics of computation described in the previous section really holds. Thus we conclude 
that the residual entropy does not exist! 

§4 Decrease of entropy and the second law 

A "unifying process" is an entropy generating process as stated above. Then the inverse of the 
unifying process, that is, a "partitioning process" must be an entropy decreasing process. The simplest 
example of this process is to insert the partition sheet when the Szilard engine is in the "n" -state. It 
is evident that the entropy decreases by A; In 2. 

So far thermodynamics has not taken into account partitioning processes. In the following we are 
discussing how the second law should be modified when the partitioned state is involved. 

There are several 'axioms' , 'theorems' or 'lemmas' expressing the second law. We classify them 
into four 'propositions' and examine them one by one. 

< 1 > Clausius's principle, Thomson's principle and Caratheodory's principle. 

These principles hold even when the partitioned states are involved. Namely, It is not necessary 
to modify < 1 >. 

< 2 > Clausius's inequality: For any realizable cycle of a system interacting with an external 
environment, the inequality 

J,; - 



holds, where d'Q is the heat that flowed into the system and T' is the temperature of the heat bath. 
If all of the processes are reversible processes, the equality holds. 

The proposition < 2 > is derived from < 1 > if Carnot's cycle is assumed to work between heat 
reservoirs with different temperatures. We believe that Carnot's cycle works. Then < 2 > holds. But 
we must be careful when we use the term reversible process. It has been believed that the process 
A — > B is reversible if B ^ A is reversible. However, this is not always true. Let B ^ A be a 
partitioning process. Then A ^ B is a unifying process. But remember that the partitioning process 
is reversible while the unifying process is not. Therefore the expression ^reversible process' in < 2 > 
must be replaced by 'reversible process in both directions'. 

< 3 > For any process A — > B, the following inequality holds: 

d'Q 



J ^ < S{B) - S{A), 



where the equality corresponds to reversible process. 

The proposition < 3 > works if a cycle made of A — > B and B — > A satisfies the Clausius's inequality, 
where the process B ^ A is a 'reversible process in both directions'. This condition is not satisfied when 
A — > B is a partitioning process (Szilard's demon). Thus it is necessary to replace the expression 'For 
any process A ^ B' by 'If A ^ B does not include partitioning processes'. Furthermore, 'reversible 
process' should be replaced by 'reversible process in both directions'. 

< 4 > In adiabatic systems entropy does not decrease, namely increases or stays constant. 

The proposition < 4 > is a result obtained by applying < 3 > to adiabatic systems. It is necessary 
to add a condition that 'if partitioning processes are not included'. 

§5 Concluding remarks 

Entropy is a controversial subject. Here we state our understanding. Entropy is an objective 
physical quantity like energy or volume. Its relation with information is expressed in eq. (1). To record 
a certain amount of information in a physical system, we have to reduce its entropy by A;ln2/bit. 

We have introduced the concept of "partitioned state" , rather intuitively. Its unambiguous defini- 
tion has not yet presented and many questions relating with this subject are unanswered. 
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